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GRAM-SCHMIDT  IMPLEMENTATION  OF  A 
LINEARLY  CONSTRAINED  ADAPTIVE  ARRAY 


I.  INTRODUCTION 


Unconstrained  adaptive  antenna  arrays  for  certain  external  noise  interference  scenarios  can  result 
in  the  cancellation  of  a  desired  signal  along  with  the  cancellation  of  the  interfering  signals.  Frost 
[1,2]  introduced  a  constrained  optimization  procedure  such  that  certain  main  beam  antenna  properties 
are  maintained  during  the  adaptation  process  thus  preserving  the  desired  signal. 


Consider  an  N  input  adaptive  antenna  array  as  shown  in  Fig.  1.  We  define  a  vector  of  weights 

w  as 

w  =  (w,,  w2,  ■  •  ■  ,  wn)t  , 

where  T  denotes  the  vector  transpose  operation.  Frost  [1]  shows  that  if  the  weights  are  constrained  to 
satisfy  the  following  linear  constraint  equation 

C'w  =  f,  (1) 

where 


M  is  the  number  of  constraint  equations, 

C  is  the  N  X  M  constraint  matrix, 
f  is  the  M  X  1  column  constraint  vector. 


and  t  denotes  the  conjugate  transpose  vector  operation,  then  the  average  output  noise  power  residue 
of  z  =  w'x  is  minimized  if 


w  =  R-'C(C'R-lCyl  f, 

where 


(2) 


x  =  (or,.  x2,  ■  ■  ■  .  xn)t  , 

=  £|xx'|  is  the  input  covariance  matrix,  and  E\  |  denotes  the  expected  value. 

In  this  report  we  develop  an  open-loop  Gram-Schmidt  (GS)  implementation  of  w'x  where  w  is 
defined  by  Eq.  (2)  or  equivalently  an  implementation  such  that 

z  =  ‘CV'C'rtJ  ‘x.  (3) 

The  GS  implementation  of  a  linearly  constrained  adaptive  array  offers  many  advantages.  The 
GS  open-loop  technique  has  been  shown  to  yield  superior  performance  simultaneously  in  arithmetic 
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efficiency,  stability,  and  convergence  rate  [3-7]  over  other  adaptive  algorithms.  In  particular,  the  sta¬ 
bility  of  the  GS  algorithm  is  enhanced  because  it  does  not  require  the  calculation  of  an  inverse  covari¬ 
ance  matrix  as  does  the  Sample  Matrix  Inversion  (SMI)  algorithm  [8],  Also  the  GS  canceller 
algorithm  is  very  suitable  for  a  non-stationary  noise  environment  because  the  adaptive  weights  can  be 
updated  in  a  numerically  efficient  manner,  using  “sliding  window”  or  systolic  techniques  on  the  input 
data  instead  of  “batch”  processing. 

Jim,  Griffiths,  and  Buckley  [9,10,11]  have  shown  that  the  constrained  minimization  problem  can 
be  reduced  to  an  unconstrained  implementation  called  the  generalized  sidelobe  canceller  (GSC).  In 
this  report,  we  develop  an  equivalent  implementation  of  this  technique.  It  had  been  previously  shown 
that  the  steady  state  solution  for  the  optimal  weights  is  identical  for  both  constrained  and  reduced 
unconstrained  problems.  In  this  report,  it  is  shown  that  if  the  SMI  or  GS  algorithms  are  employed, 
then  the  transient  weighting  vector  solution  for  the  constrained  problem  is  identical  to  equivalent  tran¬ 
sient  weighting  vector  solution  for  the  reduced  unconstrained  implementation.  In  Sections  II  through 
V,  we  develop  the  basic  building  blocks  for  the  GS  implementation  of  the  linearly  constrained  adap¬ 
tive  array.  In  Section  VI,  the  implementation  is  presented.  In  Section  VII,  the  special  case  when 
there  is  only  one  constraint  is  discussed.  In  Section  VIII  the  multiple  constraint  implementation  is 
significantly  simplified.  In  Section  IX,  the  Jim,  Griffiths,  and  Buckley  implementation  is  derived. 
Finally,  in  Section  X,  analytical  results  are  presented  for  the  convergence  rate  of  the  constrained 
minimization  implementation  when  the  SMI  algorithm  is  employed. 

II.  GS  CANCELLERS 

Consider  the  general  N -input  open-loop  GS  canceller  structure  as  seen  in  Fig.  2(a).  Let  x  | ,  x2. 
■  ■  ■.  xN  represent  the  complex  data  in  the  1st,  2nd,  Nth  channels,  respectively.  We  call  the  leftmost 
input  (.v,),  the  main  channel,  and  we  call  the  remaining  N  —  1  inputs  the  auxiliary  channels.  The 
canceller  operates  so  as  to  decorrelate  the  auxiliary  inputs  one  at  a  time  from  the  other  inputs  by 
using  the  basic  two-input  GS  processor  shown  in  Fig.  2(b).  For  example,  as  seen  in  Fig.  2(a),  in  the 
first  level  of  decomposition,  xN  is  decorrelated  with  ,xt,  x2,  '  •  •  .  xN_t.  Next,  the  output  channel  that 
results  from  decorrelating  xN  with  xN  _ ,  is  decorrelated  with  the  other  outputs  of  the  first  level  GSs. 
The  decomposition  proceeds  until  a  final  output  channel  is  generated.  If  the  decorrelation  weights  in 
each  of  the  two  input  GSs  are  computed  from  an  infinite  number  of  input  samples,  then  this  output 
channel  is  totally  decorrelated  with  the  input:  x2 ,  jr3,  •  ■  ■ ,  xN. 

Let  x*m)  represent  the  outputs  of  the  two  input  GSs  on  the  m  -  1th  level.  Then  outputs  of  the 
two-input  GSs  at  the  mth  level  are  given  by 


.  (m  L  I )  _  (m  ) 
n  An 


u,<m)  r(m) 
wn  xN-m*  1< 


n 

m 


1.  2.  •  •  •  ,  N  ~  m  . 
1,  2,  •  ■  ■  ,  N  -  1  . 


(4) 
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Note  that  x„<l)  =  x„ .  The  weight  wn(m),  seen  in  Eq.  (1),  is  computed  so  as  to  decorrelate  jc„(m  +  l)  with 
x^mJm.  For  K  input  samples  per  channel,  this  weight  is  estimated  as 


E  4-Ui 

%(m)  =  -  ,  (5) 

£  I4m-)m+.(^)l2 

*=i 

where  *  denotes  the  complex  conjugate  and  |  -  [  is  the  complex  magnitude.  Here  k  indexes  the 
time-sampled  data. 

We  simplify  the  /V- input  GS  canceller  structure  by  the  representation  as  seen  in  Fig.  3. 


X1  ; 

X  — 

C\J 

Fig.  3  —  GS  representation 

III.  NORMALIZED  GS  CANCELLER 

The  GS  canceller,  as  represented  in  Fig.  3,  effectively  weights  the  vector  x  with  a  vector 
w  =  (w,,  •  •  •  ,  wn)t  such  that  y  =  w'x,  where 


w  = 


w |  =  1,  and  is  a  scalar  constant  to  be  determined.  Because  w,  -  1.  the  scalar  constant  n  has  a 
specific  value.  If 


I  _  /  .Anm  K 


n  ,  m  =  1 ,  2,  •  •  •  ,  N  , 


i 

ft 

& 


m 


WSJ 


..■•■xkiiiiikivikni  \  if  tj*  *j«t  wl>  'jrv.V’^JVyV^^.T^niT; 
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where  r(m")  are  the  elements  of  1 ,  then  we  can  show 


r(M)  ' 


Hence 


l/r(“> 


—  p  -i 


vr  =  R 


Consider  a  configuration  where  we  normalize  the  output  y  by  the  average  power  of  y  as  seen  in 
Fig.  4.  Note  that  the  average  power  after  normalization  is  not  one.  Thus 

z  =  - - — t-  y  -  - - — —  w*x.  (10) 

E{\y\2]  E{\y\2) 


However, 


EHy  I2}  =  E{\  w'xj2} 


=  w'Ejxx'  |w 


WR^y/ 


l/r<“> 


=  (l/r(ll)* ,  0, 


0)R„  1  Rxx  Rxx  1 


=  (l/r<ll>*,0,  0, 


l/r(U) 
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Fig.  4  —  Normalized  GS  canceller 


Now  since  is  hermitian,  then  Ra  1  is  hermitian  and  rn  is  real.  Thus 

£(M2l  =  ^.  (12) 

Hence 

z  =  r(llVx,  (13) 

or  substituting  Eq.  (9)  into  Eq.  (13), 

2  =  (1,  0,  ■■■  ,  0 )R~'  \.  (14) 

IV.  NORMALIZED  FAST  ORTHOGONALIZATION  NETWORK  (FON) 

A  FON  is  a  numerically  efficient  implementation  of  a  complete  GS  network  where  each  input  is 
orthogonal ized  with  every  other  input  [12].  In  essence,  the  FON  implements  the  network  seen  in  Fig. 
5.  The  ordering  of  the  input  channels  for  decorrelation  as  seen  in  Fig.  5  was  arbitrary.  Reference  12 
shows  that  the  input  channels  can  be  ordered  so  as  to  greatly  reduce  the  required  number  of  arith¬ 
metic  operations.  If  there  were  no  logic  behind  choosing  the  ordering  of  the  input  channels,  it  can  be 
shown  that  the  number  of  weights  that  are  calculated  by  using  this  decorrelation  procedure  is  0.5 N~ 
( N  -  1).  In  Ref.  12  an  algorithm  was  developed  that  requires  approximately  1 .52V  (N  -  1)  weights 
for  the  same  decorrelation  process. 

We  represent  the  FON  implementation  of  Fig.  5  as  seen  in  Fig.  6.  Consider  an  implementation 
where  each  output  of  the  FON  is  normalized  with  respect  to  the  power  of  that  output  as  shown  in  Fig. 
7.  We  call  this  configuration  a  normalized  FON.  If  we  define  z  =  (z  (,  2i,  ■  •  •  ,  c.v)7 .  then  we  can 
show  that  the  normalized  FON  is  equivalent  to  multiplying  the  vector  x  by  an  N  x  N  matrix  of 
weights  w  such  that 
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where 


W  =  Rxx  ■ 


Note  that  we  used  the  methodology  of  the  previous  section.  Hence 


z  =  R^'x. 


We  represent  a  normalized  FON  as  shown  in  Fig.  8. 


*1  ?2 


Fig.  8  —  Normalized  FON  representation 


POWER 

NORMALIZER 


V.  NORMALIZED  REDUCED  FONS 


A  normalized  reduced  FON  orthogonal izes  only  a  fraction  of  the  inputs  with  respect  to  one 
another.  For  example  if  we  desire  only  to  orthogonalize  x ,,  x2 ,  •••.  xM ,  where  M< N,  then  a 
reduced  FON  would  efficiently  implement  the  configuration  as  seen  in  Fig.  9.  If 
z  =  (Z\.  z2,  ’  ‘ '  -  <-m)T •  then  we  can  show  that  a  normalized  reduced  FON  is  equivalent  to  multiply¬ 
ing  the  vector  x  by  an  M  x  N  matrix  such  that 


w  -  'In.m 


where 


1  0  0 
0  1  0 


=  N  x  M matrix. 


0  0  0 


%  'V  ’<  •*  \  r 


,l'l 


.•'j 
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Fig.  9  —  Normalized  reduced  FON 


1  0 

For  example,  li  2  —  0  1 


Hence 


*  =  ‘x. 


We  represent  a  normalized  reduced  FON  as  seen  in  Fig.  10. 


?2 


REDUCED  FON 
NXM 


Y1  Y2 


POWER 

NORMALIZER 


V  z2^ 


Fig  10  -  Normalized  reduced 
FON  representation 


VI.  GS  IMPLEMENTATION 


We  now  present  the  GS  implementation  of  the  linearly  constrained  adaptive  array.  First,  we 
define  an  N  x  N  augmented  matrix,  Caug ,  such  that 


KARL  GERLACH 

where  D  is  an  N  X  (N  —  M )  matrix  such  that  Caug  is  nonsingular  and  hence  invertible.  We  discuss 
the  choice  of  D  in  more  detail  in  Section  IX. 

The  GS  implementation  of  the  linearly  constrained  adaptive  array  is  shown  in  Fig.  11.  Note 


x  =  (xj,  x2,  ■■■ ,  xNy 
u  =  (w , ,  u2,  ■■■  ,  UN)T 
V  =  (v,,  V2,  •••  ,  vm)t 

y  =  (y i>  >2.  •  •  • .  ysi)T 

P  =  (P1.P2.  >Pm)T 
z  =  scalar. 


Fig.  1 1  —  GS  implementation  of  a  linearly 
constrained  adaptive  array 
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From  our  preceding  discussion  in  FONs  and  reduced  FONs,  we  know  that 

=  (2  ~  ^  x 


v  —  Im,N  Ruu  '  u  . 


Hence 


We  can  show  that 


y  =  1  v , 


z  =  f'y. 


=  E{ Caul*'  (Caug*)')  =  Cau\  C£g  , 


D  ~  1  _  ("l  D  - 1  f 
nuu  '-aug  ‘'■XX  aug  • 


v  =  /  C  » "i  r  ■  r-'v 

v  ‘M,N  '-aug  nxx  '-aug  '-aug  A 


,N  ^-aug  Rgx  *  • 


~  I m.N  C'au 


V  =  C'  /?„  1  X . 


Rvy  =  E\(C'  R~  x)  (C  R  -'x)' 


C'R-'  E\xx'\  R-'C 


C'R-'-R„-R-'C 


a  r-'c. 


Rv;'  =  (Cr^'c)-' 
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!T7Tj™W>?VnVC'jrv.V.V.  V.V  V  V 


Hence 


Finally,  by  using  Eq.  (26), 


y  =  (C'Rj'Cr'v 
=  (C'Kj'Cr'-C'JJj'x. 


z  =  t‘  (C1  R-'ey-'C'  R-lx. 


Note  that  this  is  the  same  weighting  of  x  as  given  by  Eq.  (3). 

VII,  SINGLE  CONSTRAINT  IMPLEMENTATION  EXAMPLE 

Note  that  when  M  =  1,  we  set  z  =  p  (see  Fig.  11)  and  the  function  blocks  after  p  are  not 
used.  This  results  because  the  M  X  M  FON  seen  in  Fig.  11  is  not  used,  /  =  1,  and  data  passing 
through  successive  power  normalizations  is  unchanged.  We  can  show  that 

Z  =  p  =  - l——  C'R^'x.  (36) 

CR~XC 

For  this  case  C  =  (ct,  c2,  •  •  •  ,  cs)T  =  c,  a  vector.  Note  that  the  reduced  FON  is  just  a  single  GS 
canceller.  Hence  for  a  single  constraint,  the  configuration  is  shown  in  Fig.  12. 


*1  ?2 


Fig.  12  —  GS  implementation  for  a 
single  linear  constraint 


V'-V. -v-.v-.V..*, 
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We  arbitrarily  set  =  1  and  augment  C  as  shown  below: 


1  0  0 
C  2  1  0 


1  0  0 
c  2  1  0 


r  -1  = 

'~aug 


Cfij  0  0'''  1 


-cN  0  0"  1 


Hence  the  single  constraint  processor  of  Fig.  12  can  be  implemented  as  shown  in  Fig.  13 


Fig.  13  —  hllicicm  GS  implementation  ot  a  single 
linear!)  constrained  adaptive  array 


VIII.  SIMPLIFIED  MULTIPLE  CONSTRAINT  IMPLEMENTATION 

The  GS  structure  of  the  linearly  constrained  array  given  in  Fig.  1 1  can  be  significantly  simpli¬ 
fied  as  follows.  The  N  x  M  reduced  FON  structure  can  be  functionally  decomposed  as  shown  in 
Fig.  14.  Here,  we  denote  u(,  u2,  •  •  •  .  uM  as  the  inputs  associated  with  the  outputs  of  the  N  x  M 
reduced  FON.  We  call  u  u2,  •  ■  •  ,  uM  the  primary  channels  and  write  them  as  an  M  length  vector. 
u\  We  also  denote  hW4|,  um  +  2.  •••,  us  as  the  auxiliary  channels  and  write  them  as  an  N  -  M 
length  vector,  uaux.  Note  that  embedded  in  the  N  x  M  reduced  FON  is  an  M  x  M  FON.  Hence 
Fig.  1 1  can  be  redrawn  as  seen  in  Fig.  15. 

Now  it  is  easy  to  show  that  the  operation  of  two  successive  M  x  M  normalized  FONs  is 
equivalent  to  multiplying  the  input  data  to  these  FONs  by  an  M  x  M  identity  matrix.  Hence,  the 
implementation  seen  in  Fig.  15  reduces  to  that  shown  in  Fig.  16.  Moreover,  this  structure  can  be 
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ro: 


m 


m 
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further  simplified  to  the  structure  shown  in  Fig.  17,  where  the  main  channel  input  to  the  GS  can¬ 
celler,  uin ,  is  given  by 

=  £  fm  •  (38) 

m  =  1 


Fij*  17  Simplified  GS  implementation  of  a 
linearly  constrained  adaptive  arrav 


IX.  THE  AUGMENTED  CONSTRAINT  MATRIX 

Here  we  show  that  the  generalized  sidelobe  canceller  (GSC)  implementation  of  a  linearly  con¬ 
strained  array  presented  in  Refs.  9,  10,  and  II  is  equivalent  to  the  implementation  discussed  in  Sec¬ 
tion  VIII.  We  define 


i  _ 


A 

B 


(39) 


where  A  is  an  M  x  N  matrix  and  B  is  an  (V  -  M )  x  N  matrix.  Thus 


C  1  C 

^aug  ^aug 


A 

,c 

AD 

/« 

] 

0 

B 

(c;di  = 

BC 

BD 

0 

/v  M 

; 

(40) 


where  and  Ifj-M  are  MxM  and  ( N  -  M)  x  (N  -  M)  identify  matrices,  respectively.  As  a 
result 
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AC  =lM,  (41) 

AD  =  0,  (42) 

BC  =0,  (43) 

BD  =  IN-M  .  (44) 

The  solutions  for  A  and  D  using  pseudoinverses  are 

A  =  (C'CV1  C  +  H  (45) 

D  =  B'(BB'y 1  +  G  (46) 

where  H  is  any  M  x  N  matrix  satisfying  the  condition 

HC  =  0  (47) 

and  G  is  any  (iV  -  M)  X  N  matrix  satisfying  the  equation 

BG  =  0  (48) 


Note  from  Eq.  (43)  that  rows  of  B  are  orthogonal  to  C,  the  constraint  matrix.  In  the  literature 
[10,11],  B  is  called  the  blocking  matrix.  We  can  eliminate  having  to  find  Ca~J  by  merely  defining  a 
B  that  satisfies  Eq.  (42)  and  an  A  that  is  given  by  Eq.  (45)  where  H  satisfies  (47). 

The  linearly  constrained  canceller  now  has  the  form  as  shown  in  Fig.  18.  If  we  set  H  =0  and 
define  wq  to  be  the  quiescent  weighting  (no  external  noise,  R „  =/),  then 

w,  =  C'(C'  cr'f.  (49) 

Thus  the  linearly  constrained  processor  can  be  implemented  as  shown  in  Fig.  19,  which  is  identical  to 
the  GSC  presented  in  Refs.  9,  10,  and  1 1 . 

X.  CONVERGENCE  RATE 

One  technique  for  estimating  the  optimal  weighting  vector  for  a  linearly  constrained  adaptive 
array  is  the  Sampled  Matrix  Inversion  (SMI)  algorithm  (8|.  We  will  show  in  this  section  that  this 
technique  has  fast  convergence  properties  when  applied  to  an  adaptive  array  with  linear  constraints 
This  open  loop  algorithm  is  implemented  by  estimating  the  input  covariance  matrix.  Rlt .  using  the 
samples  of  data  in  the  input  channels.  The  estimated  is  then  substituted  into  Eq  (2)  and  the  con¬ 
strained  optimal  weights,  w,  are  then  estimated.  Call  this  estimate  wSM1.  It  is  easy  to  show  using  an 
analysis  similar  to  that  presented  in  Section  VI  that  the  multiple  constraint  GS  implementation  using 
the  same  samples  as  the  linearly  constrained  SMI  algorithm  yields  an  exact  equivalent  estimated  linear 
weighting  vector,  w(;s,  as  the  SMI  algorithm,  i.e..  w(lS  =  wSmi  This  is  done  by  merely  substituting 
RLl  for  in  the  equations  given  in  Section  IV  Hence  the  GS  and  SMI  implementa¬ 

tions  of  the  linearly  contrained  adaptive  array  are  identical  in  the  transient  state  as  well  as  the  steady 
state  The  convergence  rate  properties  of  GS  implementation  of  a  linearly  constrained  array  (and  also 
the  SMI  implementation)  as  shown  in  Fig  18  can  be  easily  analyzed.  This  is  because  the  open-loop 
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0 


NOTE:  BC  =  0 


Fig.  18  —  Special  case  of  the  linearly  constrained 
canceller  implementation 


Fig  19  —  GSC  configuration 


GS  canceller  is  the  exact  equivalent  of  the  mainbeam  gain  constrained  open-loop  SMI  algorithm  [7| 
whose  convergence  properties  are  well  known  [8. 1 3J.  The  gain  in  the  steering  vector  direction  is 
constrained  to  equal  one.  which  is  equivalent  to  setting  the  weight  in  the  main  channel  equal  to  one 
for  the  GS  canceller.  We  quote  these  convergence  results.  Let  there  be  L  input  channels  and  K  zero 
mean  Gaussian  samples  per  channel,  where  the  samples  are  independent  from  time  sample  to  time 
sample  across  all  channels.  Let  ft  be  the  estimate  of  the  optimum  weights  using  the  SMI  algo¬ 
rithm.  and  let  R  be  the  input  covariance  matrix  (including  main  and  auxiliary  channels).  Define 


<r  =  ft'  R  ft . 


=  £|w'  R  w„„,  | . 


£1 


v> 


A V.’W.VV'- V-V  ">  V  W5  W  **  ’W^TOTKTynm 
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and 


z  — 


(52) 


We  note  that  a2  is  a  random  variable  and  the  output  noise  power  residue  caused  by  finite  sampling 
when  the  weights  are  applied  to  a  data  set  independent  of  the  data  set  used  to  calculate  the  weights. 

Under  the  conditions  stated,  Brennan  and  Reed  [13]  showed  that  z  has  the  following  probability 
density  function  (p.d.f.) 


K\ 

P(z)  =  * 

(L  -  2)! 

(K  -  L  +  1)! 

0, 

otherwise. 

(z  ~  1) 


L-2 


.K  +  l 


1  <  Z  <  oo  . 


The  mean  of  z  is  given  by 


£[z!  = 


K  -  L  +  1 


(53) 


(54) 


We  can  apply  these  results  to  the  adaptive  linearly  constrained  array  implementation  shown  in 
Fig.  18.  If  the  input  channels  are  zero  mean,  Gaussian,  and  independent  from  time  sample  to  time 
sample,  then  the  output  channels  after  transformation  by  the  N  x  N  matrix,  Ca~J,  are  also  zero  mean 
Gaussian  and  independent  from  time  sample  to  time  sample.  Moreover,  um ,  as  given  by  Eq.  (38),  is 
also  a  zero  mean  Gaussian  random  variable.  Hence  the  inputs  to  the  GS  canceller  satisfy  the  condi¬ 
tions  given  by  the  Brennan  and  Reed  analysis  [13]. 

For  the  constrained  implementation,  L  =  N  —  M  +  1.  Thus  if  z  is  the  normalized  output 
noise  power  of  the  linearly  constrained  array  as  defined  by  Eq.  (52),  then  z  has  the  following  p.d.f. 
and  mean 


P(z)  =  \ 


K\ 


(z 


1) 


N-M-  1 


(N  -  M  -  1 ) !  (K  -  N  +  M)\ 
0,  otherwise. 

E  Izl  = 


,*  + 1 


1  < 


<  00 


K  -  N  +  M 


(55) 


(56) 


Let  be  the  number  of  samples  needed  so  that  averge  output  noise  power  is  within  3  dB  of  the 
optimum.  Using  Eq.  (56),  we  can  show  that 


K 


VI B 


=  2  </V  -  M). 


(57) 


Now  for  an  unconstrained  adaptive  array  with  N  inputs,  it  has  been  shown  that  A',dH  =  2 S'  -  2 
Hence,  we  see  from  Eq.  (57)  that  a  constrained  array  converges  faster  for  M  >  2  than  an  uncon¬ 
strained  array  under  the  assumptions  previously  stated. 
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